Knowledge representation for the generation of quantified natural language descriptions of vehicle traffic in image sequences
نویسندگان
چکیده
Our image sequence interpretation process, which generates conceptual descriptions of the behaviour of vehicles in real-world traac scenes, essentially treated only a single vehicle (the agent) so far. Simultaneous behaviours of other vehicles in the scene have been formulated only relative to the agent. The approach discussed in this contribution allows us to quantify occurrences and thus to generate more global conceptual descriptions of behaviour by using natural language quantiiers. The semantics of such quantiied occurrences are represented by special logic structures. Natural language descriptions are derived from these internal knowledge representations .
منابع مشابه
Behavioral Knowledge Representation for the Understanding and Creation of Video Sequences
The algorithmic generation of textual descriptions of real world image sequences requires conceptual knowledge. The algorithmic generation of synthetic image sequences from textual descriptions requires conceptual knowledge, too. An explicit representation formalism for behavioral knowledge based on formal logic is presented which can be utilized in both tasks – Understanding and Creation of vi...
متن کاملDeriving Textual Descriptions of Road Traffic Queues from Video Sequences
Based on geometric results obtained by an algorithmic video (sequence) evaluation, a generic conceptual representation will be instantiated into a representation of the specific temporal developments within the recorded scene. Such an instantiated conceptual representation will in turn provide the input for a text generation subsystem. This contribution outlines a system implementation which re...
متن کاملNatural Language Texts for a Cognitive Vision System
Text-to-logic conversion is studied in a system approach which extracts a conceptual representation of temporal developments within a road traffic scene recorded by a video camera. A Fuzzy Metric Temporal Horn Logic (FMTHL) facilitates a schematic representation of road vehicle behavior at intersections. Geometric results of a model-based vehicle detection and tracking subsystem are used to int...
متن کاملNatural Language Description of Image Sequences as a Form of Knowledge Representation
An image sequence evaluation process combines information from different information sources. One of these sources is a camera which records a scene and provides the acquired information as a digitized image sequence. A different source provides knowledge regarding signal processing and geometry, exploited in order to map the image sequence signal to a system-internal representation of visible ...
متن کاملTraffic Scene Analysis using Hierarchical Sparse Topical Coding
Analyzing motion patterns in traffic videos can be exploited directly to generate high-level descriptions of the video contents. Such descriptions may further be employed in different traffic applications such as traffic phase detection and abnormal event detection. One of the most recent and successful unsupervised methods for complex traffic scene analysis is based on topic models. In this pa...
متن کامل